Basins of attraction of metastable states of the spherical p-spin model 
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We study the basins of attraction of metastable states in the spherical p-spin spin glass model, 
starting the relaxation dynamics at a given distance from a thermalized condition. Weighting 
the initial condition with the Boltzmann distribution we find a finite size for the basins. On the 
contrary, a white weighting of the initial condition implies vanishing basins of attraction. We make 
the corresponding of our results with the ones of a recently constructed effective potential. 

^\ , The so-called spherical p-spin spin glass model has been the subject of many studies: indeed, being mean-field, it 
0^ ' allows for a detailed analytic study, while still displaying very rich static and dynamical behaviours. In paricular in 
^""^ ] recent papers it has been shown that the structure of its metastable states, which dominate the Gibbs measure 

(2J[)i between two temperatures noted and (where the static and dynamic transitions respectively occur Q), is very 
^ ' rich and complex. The existence of these states is revealed using the approach of Thouless, Anderson and Palmer 
lH and they are therefore often called "TAP states" These recent works make use of the real replicas method: 

copies of the system are considered, at various distances from each other, and the free energy cost (called "effective 
, potential" function) to keep them at given distances is computed. The minima of the potential can then be associated 

with the fact that the replicas lie in metastable states, thus give informations on the distances between states. 
' This method is therefore purely static; indeed, the dynamics after a quench do not see at all the metastable states, 
^ . giving instead rise to the phenomenon known as aging Q: quenched below T^, the system remains out of equilibrium 
'slj" ' for all times with an energy higher then the thermodynamic one. On the other hand, it was shown in ||l|,||,|o| that 
, particular initial conditions for the dynamics (namely, taking the system thermalized at a certain temperature between 
Ts and Td, and then letting it evolve at another temperature) could allow a dynamical exploration of the metastable 
states finding results consistent with the picture coming from the two replica potential. 

In this letter we address the problem of determining the size of the basins of attraction of the TAP states. This will 
' be done studying the Langevin relaxation of a system starting at an initial time at a given fixed overlap (gi2 in the 
following) from an equilibrium configuration. This, of course, does not specify completely the initial conditions. In 
the following we will consider two families of them (for fixed 912), weighting the initial conditions with the Boltzmann 
^ . distribution and with the uniform one. 

I ' As we will see, the case of Boltzmann weighting can be related to the results found for a three-replica potential ||] 
' ^ ' recently introduced. Therefore, for future use, we briefly recall the results of the two- and three-replicas potentials, V2 
5 ■ and V3, for the p-spin model Q indeed, the results of the study of V2 will be used to determine the initial conditions 
Q ] of the dynamics, and those of the study of V3 wfll be compared to the outcome of the dynamics. 
• • . The two-replicas potential V2 is defined as the free energy cost to keep a configuration r at a fixed overlap qi2 
. ^ ' with an equilibrium configuration cr. While in general the two replicas can be at different temperatures, we will here 
,: limit ourselves to the case of equal temperature T for replicas 1 (cr) and 2 (r). The overlap between the replicas is 
$H denoted qi2 , while the use of the replica trick leads to a description of the second replica by a one step RSB matrix 
5^ I Q'^^ of parameters (ri,ro,x), determined variationally. The absolute minimum of the potential is always for qi2 = 0: 
then the second replica is at equilibrium, with no constraint, so the free energy cost is zero. For T < Td, o hes in one 
of the metastable states that dominate the statics (of Edwards- Anderson parameter qea), and a relative minimum 
appears for a non-zero value of (712: it corresponds to having the second replica in the same TAP state as the first. 

In order to study the organization of the metastable states in the phase space, the construction was generalized to 
three replicas in There, a first replica p is free to thermalize at T; a second replica a is constrained to thermalize 
at T with a fixed overlap qi2 with p, and the potential V3 is defined as the free energy cost to keep a third replica r 
(at the same temperature T) at overlaps qi^ from p and 923 from a. We will take Tg < T < T^: then the first replica 
is in a certain TAP state of equilibrium at T . 

Since the two first replicas are independent from the third, the overlap matrices that describe them are identical to 
the ones used for V2 . The third replica is described by a one step RSB matrix. In the minima of the potential, this 
matrix is in fact replica symmetric, with only one parameter 533. 



^we will not recall the details of the computations, which can be found in 
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The analysis of [g| showed that, depending on the value of 912, the potential can have one or two non trivial minima 
(apart from the minimum at qis = 923 = corresponding to the third replica in an unspecified equilibrium state at 
T, different from the ones of replicas 1 and 2). The first minimum, called Mi, exists for any value of qi2, and has 
Q13 — Qea and (J23 ~ qi2- Its interpretation is that the third replica lies in the same state as the first one. It therefore 
exists independently from the value of qi2. The second, more interesting minimum, called M2 in ||^, corresponds to 
the third replica close to the second one ((723 ~ Qea, qis ~ 912 < Qea)- Its interpretation is that the second replica 
lies in the basin of attracion of a metastable state at non-zero overlap qi2 from the first replica, while the third replica 
is at equilibrium in this state. This solution exists only for values of qi2 lower than a certain q (which depends on 
the temperature), with q < qsA (see figure (|l|)). This q gives therefore the minimum distance (or maximum overlap), 
from an equilibrium state at T, at which can be found another metastable state. 
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FIG. 1. Domains of existence of the minima Afi and AI2 of the potential V3 

In order to study the basins of attraction of the metastable states, we study the relaxation of a system with the 
following initial condition. We consider a reference configuration at equilibrium at temperature T. Then the system 
evolves from a configuration thermalized at temperature T, but with the constraint that its overlap with the reference 
configuration is equal to 512. At positive time the spins evolve according to an (unconstrained) Langevin dynamics 
at temperature T: 

da At) dH s. ^ 

-^^^^~Kt)^^{t)+^l^{t), (1) 

at o<7i 

where the rji are Gaussian thermal noises with {iliit)r]j{t')) — 2TSij6(t — t'), and ii{t) is a multiplier that implements 
the spherical constraint J^i'^f — N at all times. 

The goal will be to see how the system evolves dynamically, depending on the value of the initial overlap with an 
equilibrium configuration. 

In order to implement the initial conditions, we have to use the replica trick to describe the systems: the first one 
will be described by p"' with a = 1, • ■ • , n; the initial conditions are u", a = 1, • • ■ , m and only is evolving with 
time, so we will note it a{t) instead of <J^{t), with a{Q) = cr^(O). In the end the limits to ^ 0, n are taken, 
with a one-step replica symmetric breaking Ansatz. In the infinite N limit, we can obtain, in the same way as in 
pl| , p^ Jl]j9[| , a set of coupled self consistent dynamical equations for the following quantities (the equations are written 
in appendix): 
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^"(*) ^nY. K'^^i*)) (" > 1 ; '^ase a = 1 : C^{t) = C{t, 0)) ; Q„(i) = ^ E (^^(*)^°) (2) 

1=1 i=l 

While C{t,t') and R{t,t') are the usual correlation and response functions of the system, the evolution of the Co, 
and Qa will give informations on how the system departs from its initial conditions and how close it goes to the 
equilibrium state of the first real replica p. 

The initial conditions can be obtained from the study of the two- replicas potential: we first impose Qa(0) — 
— <5a,i9i2- Since the structure of the equations respect the replica symmetric character or the breaking of replica 



symmetry of the Cq, and Qa, at all times Qa{t) — Sa^iQ{t), with Q{t) = jf^i^iPiO'i{t). Then, from the value of 
qi2, we use the two replicas potential to deduct the values for Cq(0). According to the value of 912, it can be replica 
symmetric or have one step of replica symmetry breaking. Since the replica symmetric case can be recovered in a 
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simple way from the equations of the RSB case, we will consider only the one step case. Then the initial conditions 
for Ca has parameters (ri , rg , x) ; therefore at all times the Cq, {t) will have the form 

C^it) = {C{t,Q),Ci{t),Ca{t)) (3) 

with the same breaking parameter x 0, and Ci(0) = ri, Co(0) = tq 0. We define the following limiting values: 

lim Q{t) ^ go ; lim C(t, 0) = p 

£ — ^oo t — *oo 

lim Ci{t) = ci ; lim Co(t) = cq ; lim = (4) 

£ — *oo t — >oc t — 'oo 

A simple check is to look at what happens in two extreme cases: (i) qi2 — 1: the system starts at equilibrium at 
T; then ri = = 1, and obviously we obtain C(i,0) = Q{t) = Ci{t) = Ca{t), qa = p = ci = cq = Qea- the system 
thermalizes in the particular equilibrium state at T chosen by p; (ii) qi2 — 0: the system is not constrained, so clearly 
we obtain Q{t) = Ci(t)= Co{t) — 0, C{t,t') = C{t — t') = C(r): the system thermalizes in an unspecified TAP state 
of equilibrium at T [^H]. 

For other values of qi2, the numerical integration of the dynamical equations shows that the system, after a 
transient, reaches a certain equilibrium behaviour; to study the system at long times, we therefore make the Ansatz: 
C{t,t') = Cit ~ t') = C(t), R{t,t') = Rlt - t') = R{t) = -i^, with linv_oo C(r) = q. This Ansatz allows, with 
usual methods, to obtain coupled equations for the limiting values of the various one-time quantities, and moreover 
we have for the evolution of the asymptotic correlation function: 

— = - Y^(C(r) ~q)~pj^du {f'{C[T - u)) - nq))C\u). (5) 

The equations for the values of o, go, P, ci, co are equivalent to the equations for the parameters 533, (713, 523, 1^23, 
Z23 of the thrcc-rcplicas potential Q This correspondence pushes forward the one noted in between the potential 
with two replicas and the dynamics with thermalized initial conditions. Here, the interpretation is that the first replica 
p lies in an equilibrium state at temperature T, the replica number 2 of the potential gives the initial conditions of 
the dynamics, while the dynamical system goes towards a minimum of the potential (given in the potential approach 
by the third replica), where it relaxes according to (^), which is exactly the equation of the relaxation in a TAP state 
of self-overlap g, as given in 

An important difference between the two approaches is that, while the potential can be explored for all values of 
9i2, 9i3, 923 (i-e. all positions of both replicas 2 and 3), the only parameter of the studied dynamics is (712: the initial 
conditions of the dynamics can be compared to the second replica of the potential, and all possible values of qi2 can 
be studied, but the values of go, P are outcomes of the dynamics and are not chosen. From the equivalence between 
potential and dynamics, it follows for the dynamics that, while for 1712 > q only the solution Mi exists, for qi2 < q 
there are the two solutions Mi and M2. However, as the dynamical equations admit (within the 1-step RSB Ansatz 
we use) a unique solution for any finite time, only one of the two can be reached dynamically. The size of the basin 
of attraction of the equilibrium states is related to the smallest value of qu for which the solution Mi is reached. 

In order to settle this question we integrate numerically the dynamical equations ( |Al| ). For simplicity we limit our 
analysis to the case p = 3 for which most of the analysis of |^ was done. Then Tg « 0.586, Td « 0.61237 and we 
will show results for T = 0.6: then qEA = 0.6, q f» 0.342. The numerical integration is done using a simple iteration 
algorithm, discretizing the dynamical equations with a finite time-step h. We proceed with three values h, 2h, Ah and 
then do the interpolation at /i — s- to compare the numerical values with the values obtained from the study of the 
potential V3 0. 

For "small" values of qi2, the dynamics converge rapidly towards an equilibrium behaviour with time tranlsation 
invariance and fluctuation-dissipation relation. The numerical integration yields limits in excellent accordance with 
the resolution of the aforementioned equations for g, go, P, ci, cq, and coincide with the values of the various parameters 
in the minimum M2 of the three replicas potential, (e.g., see figure (H), gi2 = 0.155702, then ri = ro = 0.02715, 
go = 0.116338, ci co = 0.0205437, g = 0.608423, p = 0.609467. These values coincide with the values respectively 



^This means that Ca{t) is equal to C{t, 0) for a = 1, to Ci{t) for a — 2, x, and to Co{t) for a — x + 1, n. 
^to recover the RS case, we take ri — ro: then, at all times, Ci{t) — Co{t). 
■^in the RS case, the equivalence is 533 — q, qo = qis, ci — cq — p — 523. 

^ after checking that the interpolation at /i — > coincides well with the values obtained via the potential, we used a unique 
value of the time step for some runs that involved larger timescales, at values of gi2 close to the limit of the attraction basin. 
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of gi3, W23 = Z23, <?33, 923 in the minimum M2.) This means that the system a{t) stays in the state found by the 
repHca (t(0), with finite overlap with p. We are therefore in the minimum M2, and out of the attraction basin of the 
equihbrium state where p lies. 

For qi2 "large" , conversely, we expect that the system, which starts close to p, remains in the same state. This is 
indeed what we find (e.g. for qi2 — 0.817272, then ri = ro — 0.7859; we obtain qo = q = qEA, ci = cq = p = 0.633625; 
the integration of two-times equations coincide well with the integrations of the equation on C(t) and with these 
values). For a somewhat smaller value of qi2 (e.g., see figure (||), qi2 = 0.55, ri — ro = 0.556345), the same behaviour 
is obtained: the two times equations yield the same results as the equations using the equilibrium Ansatz, with 
go = 9 = QEA, ci = Co = p = 0.571534). 

For these values of qi2, the system thermalizes therefore in the TAP state found by p. The long time dynamics is 
the relaxation dynamics in a TAP state of equlibrium at T, therefore do not depend on the initial conditions. 
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FIG. 2. Evolution of C{t, 0), Q{t) and C'i{t) = Co{t) with time for gi2 = 0.155702 (left) and 912 = 0.55 (right). These curves 
correspond to the extrapolation at /i — > of the results of the numerical integration with h = 0.05, 0.1, 0.2; we see that they 
go quite fast to their limiting values p, qo and ci = cq (given by the horizontal lines), with moreover p = ci — co for qi2 — 0.55. 

The outcome of the dynamics for small and large values of qi2 show that both minima Mi and M2 can be dynamically 
reached. We can then naturally ask if a minimum is always reached, and what is the limiting value of qi2 for which 
the system goes towards p. We therefore study the behaviour of the system for values of qi2 decreasing towards q, 
and also for values lower than, but close to q. We observe that, while for large values of qi2 (or also for values of qi2 
lower than q) the one-time quantities go directly to their limiting values, upon decreasing qi2 a plateau appears at 
an intermediate value between the initial and the limiting values. This plateau gives a timescale t* that grows and 
diverges when qi2 q. We show the various one-time quantities for a particular value of qi2, and the evolution of 
the plateau and of the timescale with qi2, in figures (||) and (^). For qi2 lower than g, we observe that the dynamics 
converges towards the values of the parameters in the minimum M2 of the potential, and do no more reach Mi. 
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FIG. 3. Left: Evolution with time of the one-time quantities C{t,0), Ci{t), Co{t), Q{t), for qi2 = 0.353. We ob- 
serve the presence of a plateau until t* ~ 500 before the quantities reach their final values corresponding to Mi. Right: 
Evolution with time of Q{t) for various values of q\2- From bottom to top, q\2 ~ 0.32, 0.33, 0.34 (< q), and 
gi2 = 0.344, 0.345, 0.346, 0.347, 0.348, 0.35, 0.36, 0.37, 0.38, 0.39, 0.55 {> q): we see the growth of the timescale given by 
the length of the plateau as qi2 decreases towards q. For gi2 > q, we see that all the curves go to the same limit corresponding 
to Ml, while the limiting value depends on qi2 for qi2 < q. In both figures, the time-step used is h — 0.2. 




The situation is therefore that, for any qi2 > q, the system reaches the state where the first replica, p, lies, but 
after a transient which length diverges as qi2 goes to q. For initial conditions farther from p than q, i.e. as soon as 
the minimum M2 of the potential exists, the system relaxes in the state corresponding to M2, which is a metastable 
state at finite overlap with p, and is no more able to "reach" p. We can therefore understand q as the limit of the 
attraction basin of the state where p lies. It is worth noting that q is quite small {q ~ 0.342 for T = 0.6), which 
means that it is possible to find configurations that will dynamically evolve towards a TAP state, and thermalize in 
it within a finite time, even at quite large distances from typical configurations of this state. 

This is the situation that we find if we weight the initial condition with the Boltzmann probability. Let us turn now 
briefly to the case of initial conditions with overlap qi2 with p, but otherwise uniformly distributed. In this case the 
basins of attraction are vanishing. Indeed for any value of qi2 we find that the asymptotic value of the energy is larger 
than the equilibrium value E^q (the energy of p) . As far as the correlations with the initial state are concerned we have 
found two different regimes, separated by a (rather large) threshold value q* of qi2 (e.g. q* « 0.99 for p = 3, T = 0.6). 
For q > q* the system reaches a time translation invariant situation, with final energy that depends continuously 
on qi2 (see fig. (0)). The overlap with the initial condition tends to a non zero value in this case, and the relation 
between the asymptotic energy and the Edwards- Anderson parameter is the one verified in the TAP states, indicating 
equilibration within a metastable state. For q < q* instead, the system looses the correlation with the initial state 
(and with p) and irrespectively of qi2, falls into an aging state with asymptotic energy equal to Edyn{T) analogous 
to the one discussed in where the dynamics starts from a completely random initial condition. The situation can 
be understood analysing the energy of the initial state. For each value of 512 this energy takes with probability one a 
fixed value £'(512), which is a decreasing function of qi2 and equals Eeq{T) for qi2 — \. It is tempting at this point to 
interpret the initial states as typical states with that energy, i.e. as equilibrium states at a corresponding temperature 
T(gi2). If this is true then for T{qi2) < Td the typical initial configuration is in the basins of metastable states that 
survive at temperature T ]l|,p|pO|, although they are slightly deformed. The dynamics at temperature T leads then to 
equilibrium in these states. For T{qi2) > Td the typical initial configuration belongs to the paramagnetic state, and 
aging has to be expected, this means that T{q*) = Td- We have checked that this is indeed the right scenario using 
the techniques of |l|,|^,[l0| , finding the interesting result that arbitrarily close to an equlibrium state at temperature 
T, there are states which are of equilibrium at some other temperature. 
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FIG. 5. Evolution of the energy of the system starting at overlap qi2 = 1., 0.999, 0.998, 0.995, 0.99 (symbols, from bottom 
to top) from an equilibrium configuration p at T = 0.6 (p = 3), but otherwise randomly; the lines give the equilibrium energy 
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dyn 



-0.82467. 



In this letter, we have studied by a dynamical approach the attraction basin of an equilibrium state at temperature 
Ts < T < Td (and established the correpondence with the static three- replicas potential). If we weight with the 
Boltzmann distribution we find wide basins of attraction. Almost all initial conditions with overlap larger than a 
threshold value g, are in the basin of attraction of the reference state. Conversely if we perform a white average we 
find zero size basins of attraction. Starting close enough to the reference configuration, the system equilibrates in 
a TAP state close to the starting point, while if the initial overlap is larger than this threshold the system ends up 
aging. This combination of facts indicates a highly non trivial structure of the various states and basins of attraction 
in configuration space. 
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APPENDIX A: DYNAMICAL EQUATIONS 



Denoting f{q) — l/2qP, and using the methods of |l|j9|, |ll| , |l2| one can show that the following dynamical equations 
are obeyed: 

fi{t) = / ds {f{C{t, s)) + fiCit, s))C{t, s))R{t, s) + pr{Q{t))Q{t) +(3J2 nCa{t))C^{t) 
^^^Ml ^ -^,{t)R{t, t') + j' ds /" (C(i, s))R{t, s)i?(s, t') 

^^iMl ^ -^{t)C{t, t') + f ds f'{C{t, s))R{t', s)+ f ds f"{C{t, s))R{t, s)C{t', s) 
c** Jo Jo 

m 

+PnQ{t))Q{t')+f3j2f{Cc.{t))Ca{t') 

a=l 

„t m 

-mCc.{t) + / ds f"{C{t, s))R{t, s)CUs) + f3f'm))qu +f3j2 f'iCpit))Q^^fs 

0=1 

-^i{t)Qa{t)+ / ds f"{C{t,s))R{t,s)Qa{s)~^(3nQa{t)) + f3Y,nC^{t))Q\^^^ (Al) 



dCg 
dt 

dQa 
dt 

Q = i 

where Q^^ and Q^^ are the matrices used in the two- replicas potential Using the 1-step RSB Ansatz, i.e. Ca{t) = 
{C{t, 0), Ci{t), Co{t)) with breaking point x, with initial conditions Ci(0) = ri; Co(0) = ro, Q{0) = gi2, we can obtain 
the equations for C{t,t'), R{t,t'), Ci{t), Co{t), Q{t) by expanding the sums in the previous equations; for example: 
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J2nC^it))C^{t') = f{Cit,0))Cit',0) + (x- l)/'(Ci(t))Ci(t') -a;/'(Co(t))Co(t') (A2) 



[1] S. Franz and G. Parisi, J. Phys. I (France) 5, 1401 (1995). 

[2] A. Cavagna, I. Giardina and G. Parisi, J. Phys. A. 30, 4449 (1997). 

[3] A. Cavagna, I. Gia rdina and G. Parisi, An investigation of the hidden structure of states in a mean-field spin glass model, 



cond-mat 9706027, to appear in J. Phys. A. 
[4] A. Crisanti and H.-J. Sommers, Z. Phys. B 87, 341 (1992); A. Crisanti, H. Horner, and H.-J. Sommers, Z. Phys. B 92, 
257 (1993). 

[5] D. J. Thouless, P. W. Anderson, and R. G. Palmer, Phil. Mag. 35, 593 (1977). 

[6] J. Kurchan, G. Parisi, and M. A. Virasoro, J. Phys. I France 3, 1819 (1993). 

[7] A. Crisanti and H.-J. Sommers, J. Phys. I (France) 5, 805 (1995). 

[8] L. F. Cughandolo and J. Kurchan, Phys. Rev. Lett. 71, 173 (1993). 

[9] A. Barrat, R. Burioni, and M. Mezard, J. Phys. A 29, L81 (1996). 
[10] A. Barrat, S. Franz and G. Parisi, J. Phys. A 30, 5593 (1997). 
[11] A. Houghton, S. Jain, and A. P. Young, Phys. Rev. B 28, 290 (1983). 

[12] D. Thirumalai and T. R. Kirkpatrick, Phys. Rev. B 38, 4881 (1988); T. R. Kirkpatrick and D. Thirumalai, J. Phys. A 22, 
L149 (1989). 



7 



